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Abstract 

In the design of decentralized networked systems, it is useful to know whether a given network 
topology can sustain stable dynamics. We consider a basic version of this problem here: given a 

r ^ ' vector space of sparse real matrices, does it contain a stable (Hurwitz) matrix? Said differently, 

is a feedback channel (corresponding to a non-zero entry) necessary for stabilization or can it be 
done without. We provide in this paper a set of necessary and a set of sufhcicnt conditions for the 

i-G , existence of stable matrices in a vector space of sparse matrices. We further prove some properties 

C^ ' of the set of sparse matrix spaces that contain Hurwitz matrices. The conditions we exhibit are 

most easily stated in the language of graph theory, which we thus adopt in this paper. 
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^ ! 1 Introduction 

fT^ , Many problems of practical and theoretical nature in control, biology and communications 

tH- I are characterized by an underlying network topology describing which interactions within a 

O ■ system are allowed, see e.g. |May(1972)[|Rotkowitz and Lall(2006)"||Fax and Murray(200"4)' 



m 



Ali Jadbabaie, Jie Lin, and A. Stephen Morse (2003) [S. Sundaram and C. N. Hadjicostis(2011) 



A. Nedic and A. Ozdaglar(2009)|Dahleh and Rinehart(2011)] and references therein. Such 



problems include information transmission, distributed computation, the study of metabolic 
^\ . networks, robot motion planning Desai, Ostrowski, and Kumar (2001)], etc. The solution 



j^ , to particular problems of this nature can often be obtained from the broader study of 

the class of systems constrained by the given network topology. In this vein, the problem 
we address here is the one of stability of linear dynamics. The question we answer is: 
"can a given network topology sustain stable linear dynamics?" We give a set of necessary 
and a set of sufficient conditions for the existence of stable dynamical systems constrained 
by a given topology. Furthermore, we establish some structural properties of the set of 
topologies that can sustain stable dynamics. 
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2 Preliminaries and summary of results 



The stability of linear dynamics is well-understood when there are no communication 
constraints in the system. Necessary and sufficient conditions in this case are given by 
the well-known Routh-Hurwitz criterion Horn and Johnson(1990)|. These conditions are, 



however, not easily managed and their application in the networked case does not appear 
to yield manageable results. We adopt a different approach in this paper: we first relate 
the algebraic representation of a class of systems sharing the same underlying topology to a 
graphical representation and exhibit continuous and discrete symmetries that leave the class 
of systems invariant; from there, we define an algebraic set whose symmetries make it easier 
to derive conditions for stability. While the use of graphical methods in control is not new 
(see [Lin(1974") , Mesbahi and Egerstedt(2010)| or the early monograph [Reinschke(1988) | ) , 



our approach departs from earlier work in the sense that it relates graph theoretic properties 
to systems' stability. We will show in this paper that Hamiltonian decompositions of 
graphs are a natural ingredient if one is to relate systems' stability to an underlying graph. 
Indeed, such decompositions appear in the statement of several of our main results below 
(Theorem [21 Theorem [3] and Theorem [5]). Another important notion that is introduced 
in this work is the one of minimally stable graphs (defined in the next section); in fact, 
one objective of the present line of work is to characterize all minimally stable graphs. We 
make a first step in this direction in the last section. 

The paper is structured as follows. In the next section, we give a general overview of 
the problem, establish the notation and state the main results. In Section [3l we introduce 
the group actions and the algebraic set just mentioned. In Sections [4] and O we prove the 
main results of the paper. 

2 Preliminaries and summary of results 

Let n > be a positive integer. Denote by (R"^" the vector space of real n by n ma- 
trices. We are concerned with some linear subspaces of R"^", namely the ones obtained 
by forcing one or several entries of the matrices to be zero. Precisely, let a be a set 
of pairs of integers between 1 and n, that is a C {l,...,n} x {l,...,n}. We define 
Sq to be the vector space of matrices with entries indexed by a free, and other en- 
tries set to zero. We denote by |a| the cardinality of a. For example, if n = 4 and 
Q = {(1,2), (1,3), (2,1), (2, 2), (2, 3), (3, 2), (4,1), (4, 3), (4, 4)}, then E„ is the subspace of 

matrices of the form 

"0**0" 

* * * 

0*00 





A 



where the * represent arbitrary real numbers. We call the vector spaces Sq, sparse matrix 
spaces (SMS). We call the * entries free variables and the other entries zero variables. 

We say that a matrix is stable if the real-part of its eigenvalues is strictly negative. 
We call a sparse matrix space stable if it contains a stable matrix, and unstable otherwise. 



2 Preliminaries and summary of results 




Fig. 1: The graph depicts the vector space Sq described in ([T]) 

Our objective is to characterize the stable and unstable sparse matrix spaces. To this end, 
it is convenient to adopt the following graphical representation for the Sq,'s: to a vector 
subspace Sq, C R"^", we associate a directed graph (digraph) G = iV^E) with n vertices 
and dimSa = |a| edges defined as follows: there is an edge between vertices vi and Vj if 
(i, j) is in a, or, said otherwise, if aij is a free variable. Hence the more sparse the matrices 
in Sq, the fewer edges in the corresponding graph. 

Some rather intuitive necessary conditions for stability are easily obtained and expressed 
in the graphical representation. The first is that the graph has a node with a self-loop0: 
indeed, a stable matrix necessarily has a negative trace and since self-loops correspond to 
diagonal elements in the sparse matrix space, at least one free variable on the diagonal 
is needed. We call nodes with self-loops sinks. We thus record the following necessary 
condition: a graph is stable only if it has a node with a self-loop. Recall that a strongly 
connected component [Diestel(2010)| is a maximal (in terms of number of nodes and edges) 
subgraph that is strongly connected, that is for which there exists a directed path joining 
any two pairs of vertices. For example, in the graph depicted below, the subgraph on 
{1,2,3} is a strongly connected component. 




Self-loops in a graph can be understood as elements that dissipate energy. From that 
point of view, it seems reasonable to expect that every node is strongly connected to a 
node with a self-loop, or, informally, that every node in the graph can see and is seen by 
an element that dissipates energy. We thus extend the previously mentioned necessary 
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A self-loop, also called a buckle, is an edge that starts and ends at the same vertex 
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r> a 



(2)- 



Fig. 2: Even though both graphs are strongly connected, the SMS with correspondmg 
graph depicted on the left is not stable, whereas the one with corresponding graph 
depicted on the right is. We provide in this paper (see Theorem [2] and [3]) conditions 
that are strong enough to explain why the behavior of systems defined of these two 
graphs differ. 

condition as follows: a graph is stable only if every node belongs to a strongly connected 
component with a sink. 

We summarize this discussion in the following Theorem: 

Theorem 1. A sparse matrix space is stable only if every node in the associated graph 
belongs to a strongly connected component with a sink. 

This latter condition is not as straightforward to prove as the first one (hence we give a 
formal proof of it below) , but in some sense encompasses a condition that is fairly intuitive 
given the graphical representation of a SMS. This condition, however, is far from being 
sufficient, a simple counter-example being given by the graph on the left in Figure [2j 
One objective of this paper is, besides introducing more refined conditions, introduce the 
machinery and tools that allow to go beyond Theorem [TJ 

In addition to necessary and sufficient conditions for stability, we investigate structural 
properties of the set of sparse matrix spaces with an eye towards providing a classification 
of stable and unstable topologies. To understand the nature of these results, it is helpful 
to keep in mind the rule of thumb stating that adding edges helps stability and removing 
edges helps instability. This leads to the definition of minimally stable graphs: graphs 
that are stable and such that removing any edge yields an unstable graph. To be more 
formal, observe that sparse matrix spaces can naturally be partially ordered according to 
subspace inclusion and that if a sparse matrix space S^ is unstable, every subspace of E„ 
unstable. Reciprocally, if S^ is stable, every subspace that contains E^ is stable. In terms 
of the graphical representation, graphs partially ordered as just described are easily seen to 
correspond to graphs with added or removed edges. The above facts allow us to talk about 
minimally stable sparse matrix spaces, that is stable sparse matrix spaces such that every 
sparse matrix space obtained from it by adding a zero (viz. removing an edge) is unstable, 
and maximally unstable sparse matrix spaces, that is unstable sparse matrix spaces such 
that every sparse matrix space obtained from it by removing a zero (viz. adding an edge) 
is stable. 
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With this in mind, we prove the fohowing facts about maximahy unstable sparse matrix 
spaces: the minimal number of zero variables in an unstable SMS is n, that is every SMS 
with less than n zero is stable. In fact, we will show that there is a unique maximally 
unstable sparse matrix space, we call it S^p, with n zeros: this is the space of matrices 
with zero diagonal entries. Next, we consider matrix spaces with one non-zero diagonal 
entry, which are obviously not included in Sog- We show that these spaces have at least 
n — 1 off-diagonal zeros; said otherwise, if a matrix space has at least one non-zero diagonal 
entry and at most n — 2 off-diagonal zeros, then it is stable. 

2.1 Graphs and Hamiltonian decompositions 

We establish here the vocabulary used to deal with graphs. We say that G' = {V , E') 
is a subgraph of G, denoted by G' C G, if G' is a graph and V C V, E' C E. A 
class of subgraphs frequently used consists of subgraphs induced by a vertex set: we call 
G' = {V, E') the subgraph of G induced by the vertex set V' if E' contains all edges of G 
that both start and end at vertices of V' , that is 

E' = {{vi.Vj) I Vi.Vj e V and {vi,Vj) G E}. 

We say that two subgraphs Gi , G2 C G are disjoint if their vertex sets (and hence edge 
sets) are disjoint. We say that Gi, . . . ,Gk C G is a decomposition of G if the Gj's are 
pairwise disjoint and the union of the vertex sets of the Gj is the vertex set of G. For the 
example of the graph depicted above, the subgraph induced by the vertex set {1, 2, 3} con- 
tains the edges {(1, 2), (2, 3), (3, 1)}. This subgraph is disjoint from the subgraph induced 
by the vertex set {4, 5}, and they together form a decomposition of G. 

Recall that a path of length A; in a graph is a sequence of vertices vi, . . . ,Vk connected 
by edges, i.e. such that {vi,Vi+i) G E ioi i = 1 . . .k— 1. A cycle is path with vi = Vk- A 
Hamiltonian cycle is a cycle that visits every vertex exactly once, except for the origin 
vertex, which is visited twice |Diestel(2010)| . Clearly, not all graphs admit Hamiltonian 
cycles. We call a Hamiltonian decom,position of the graph G a decomposition of G into 
disjoint subgraphs Gi, . . . , Gm where each Gi admits a Hamiltonian cycle. An important 
object in this work is the following: 

Definition 1. Let G = {V,E). A Hamiltonian subgraph is a subgraph of G which admits 
a Hamiltonian decomposition. A Hamiltonian k-subgraph is a Hamiltonian subgraph of 
cardinality k. 

We illustrate these definitions in Figure [3l 

2.2 Necessary and sufficient conditions 

We are now in a position to state further conditions to decide the stability of sparse matrix 
spaces: 
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Fig. 3: The graph depicted above admits several Hamiltonian decompositions: one into 
the cycles (12) and (345), one into the cycles (15), (23), (4) and one into the cy- 
cle (12345). The subgraph induced by the vertices {1,2,3,4} is a 4-Hamiltonian 
subgraph of G. 

Theorem 2 (Necessary condition for stability). A sparse matrix space is stable only if its 
associated graph contains, for each k = 1, . . . ,n, a Hamiltonian k-subgraph. 

Theorem 3 (Sufficient condition for stability). A sparse matrix space is stable if its as- 
sociated graph G contains a sequence of nested Hamiltonian subgraphs Gi C G2 C . . . C 

Gn-l c G. 

Notice that the strict inclusions imply that the vertex set V^ of G^ has cardinality k. 
From Theorem [2l we conclude that the graph on the left in Figure [2] is unstable, even 
though every node is strongly connected to a sink. From Theorem [3l we conclude that the 
graph on the right in Figure [2] is stable, a sequence of nested Hamiltonian subgraphs being 
given by the subgraphs induced by {1} and {1,2}. We give further examples: consider the 
sparse matrix spaces 



* * 

* * 

* * 
0*0* 

* 



and E 



/3 



* * * 
0*00 

* * 
0* 

* * 



The SMS Eq, is stable since its associated graph, depicted in the Figure below left, 
satisfies the conditions of Theorem [3] with G^ = {vi, . . . ,Vk}. The Hamiltonian decompo- 
sitions are respectively given by {{ui}}, {{vi,V2}}, {{vi,V2,V3}},{{vi,V2},{v3,V4}} and 
{{vi,V2,V3,V4, V5}}, each of these subgraphs having an obvious Hamiltonian cycle. On the 
contrary, the SMS S^, is not stable since the corresponding graph, depicted below right, 
contains no Hamiltonian 4-subgraph. 
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3 The subspace of unstable SMS and its symmetries 

We introduce in this section a subset of R*^^" that contains all the unstable sparse matrix 
spaces. This subspace, which is the common zero set of polynomial equations and is 
thus an algebraic set, is used extensively in the proof of the main results below. This 
subspace has a large number of symmetries, which we also study here. We now exhibit three 
straightforward operations that map stable SMS to stable SMS, a continuous operation and 
two discrete operations. 

We start with the simpler discrete operation, which corresponds to matrix transposition. 
If a = {(a, 6), (c, (i), . . .} is a sparse matrix space, we define 

a' = {{b,a),id,c),...}. (2) 

In terms of matrix representation, if ^ G Sq,, then A' G Sq,/. In terms of graphical 
representation, it corresponds to changing the direction of all edges of the graph. That is, 
{vi,Vj) is an edge of the graph associated to a if and only if {vj,Vi) is an edge of the graph 
associated to a' . We record here the following obvious result: 

Lemma 1. The sparse matrix space a is stable if and only if a' is stable. 

3.1 Conjugation by permutation matrices 

Recall that the symmetric group Sn acts on an ordered set of n symbols by permuting its 
elements. The elements of Sn are called permutations. Let o" G S'n, we use the following 
standard notation to represent permutations: we write a = {ai,ai, . . . ,an), where CTj € 
{1, . . . ,n} and ai ^ aj for all pairs i ^ j, to represent the permutation whose action on 
{1,2, . . . ,n} moves the element in position Cj to position i. For example a = (1,3,4,2) 
acting on {a,b,c,d) yields {a,c,d,b). We denote the composition of u, r G 5„ by ar, by e 
the identity permutation and by a~^ the unique inverse permutation of a. 

We also use the representation of the symmetric group as n by n matrices: to each 
(T G Sn, we associate the n by n matrix P„ obtained by permuting the columns of the 
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identity matrix according to a. For example 

a = (1,3,4,2) ^P„ 



We let the symmetric group act on a sparse matrix space a = {(a, 6), (c, d), . . .} via 

a{a) = {{ua, (Jb), (cJc, ad), ■ ■ ■} 
In terms of matrix representation, this yields 
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{PaAP^^ s.t. A G S^}. 



For example, for the Sq, of ([T]), we have that Ti^^fa) contains matrices of the form 
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(3) 



We say that a is even (resp. odd) if det(Po-) = 1 (resp. det(Po-) = — !)• We write (—1)'^ for 
det(P(j). Finally, in terms of the graphical representation, this action of Sn corresponds to 
relabelling the vertices and the edges following 

Vi — > Va^ and ivi,Vj) — > {va^,v„^). 

We have the following result 

Lemma 2. A sparse matrix space Eq is stable (resp. unstable) if and only ifEf^/^) ^^ stable 
(resp. unstable) for all a (z Sn 

Proof. Assume Sq, is stable and denote by ^ a stable matrix in Sq, then P^AP^^ is also 
stable and belongs to ^^(a) . Reciprocally, assume there exists a a such that ^^(q,) is stable 
and let ^ be a stable matrix in So-(a)5 then P~^AP„ belongs to S^ and is stable. D 

3.2 Multiplication by non-singular diagonal matrices 

We observe that multiplication to the left by a non-singular diagonal matrix maps a sparse 
matrix space to itself; that is 

DJ^a = S„, (4) 

and similarly for multiplication to the right: Ti^D = Sq. 

We say that a matrix A is left- (resp. right- or both left-right-) diagonally stabilizable if 
there exists a diagonal matrix D such that DA (resp. AD or D1AD2) is stable. We record 
the following fact about diagonally stabilizable matrices, which says that the sets of left-, 
right-, and left-right- diagonally stabilizable matrices are the same. 
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Lemma 3. The following statements are equivalent: 

1. A is left- diagonally stabilizable. 

2. A is right- diagonally stabilizable. 

3. A is left-right-diagonally stabilizable. 

Proof. Let A € R"^". First, observe that 1 =^ 3 and 2^3 are obvious. In view of this, 
we show that 3 =^ 2 and 3 => 1 and this will prove the Lemma. To this end, assume that 
D1AD2 is stable for invertible Di,D2. Then D2D1AD2D2 = D2D1A is also stable and 
D2D1 is diagonal. Similarly, AD2D1 is stable. D 

The above result justifies the terminology diagonally stabilizable^ without having to 
specify left or right. We have the following result, whose proof is obvious in view of (H]): 

Lemma 4. A sparse matrix space is unstable if and only if it does not contain any diago- 
nally stabilizable matrix. 

We now characterize the set of diagonally stabilizable matrices: for a subset X C 
{1, 2, . . . , n}, we denote by Ax the principal submatrix of A whose rows and columns are 
indexed by X. We denote by \X\ the cardinality of X. A leading principal minor is a 
principal minor det(^i) where X of the form {1, 2, . . . , A;}, k G {1, . . . n}. We have the 
following result, taken from Yu, Anderson, Dasgupta and Fidan: 



Lemma 5. ^ Yu et al.(2009)Yu, Anderson, Dasgupta, and FidanI If the leading principal 



minors of A ^ ^nxn ^^^ non-zero, then A is diagonally stabilizable. 

The above condition is not necessary; a simple example of this fact is given by the 

stable matrix 

"0 -1" 

2 -1 • 



A 



(5) 



For our purposes, we establish the following straightforward extension: 



Corollary 1. Let A £ R"^". // there exists a a Sn such that the leading principal minors 
of PfjAP~^ are non-zero, then A is stable. 

Proof. Assume that there exists a permutation a & Sn such that the leading principal 
minors of PaAP~^ are non-zero. We exhibit a matrix D such that DA is stable. By 
Lemma[5l there exists Di such that DiPfjAP~^ is stable. Observe that D = P~^DiPfj is a 
diagonal matrix and P^'^{DiPcrAP^^)P(j = DA is stable (because similar to DiPa-AP^^). 

D 

While the above result yields a stronger condition than Lemma El and in particular 
recognizes the matrix in ([5]) to be diagonally stabilizable, it is not a necessary and sufficient 
condition. 
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3.3 Unstable sparse matrix spaces 

Because they appear frequently in the remainder of the paper, we introduce a short-hand 
notation for leading principal minors: we denote by detk{A) the kth leading principal minor 
of A. Hence deti{A) = aii,det2(^) = 011022 — 012021; etc. We also use the shorthand 
notation deti{a{A)) = deti(P^AP-i). 

Let o" G 5n, we introduce the polynomial Pa{A): 

p^{A) = deti((j(A)) det2{a{A)) . . . det„_i(a(^)). (6) 

That is, Pcr{A) is the product of the leading principal minors of P^jAP^^. 
We introduce the algebraic set 

V = {Ae V""" s.t. p„{A) = for ah cj G 5„} . (7) 

As a consequence of Lemma HI we have the following result: 

Theorem 4. /f Sq is an unstable sparse matrix space, then Sq, C V. 

We summarize in the following proposition the symmetries of V: 

Proposition 1. Let A G V. Then 

1. A' G V 

2. DA G V for all invertible diagonal matrices D 

3. PrAP-^ G V for any r G S'„, 

4- if A £ V is invertible, A^^ G V 

Proof. If A G V, then for all a G 5„, Pa{A) = 0. For the first statement, we have 
deti{A) = deti{A'), which implies that Pa{A) = Pa{A') for any permutation a, which 
proves the claim. For the second statement, observe that det((D^)j) = det{Dx) det(Aj) 
for all subset I of {1,2, . . . ,n}. Hence po-{DA) = kpa{A) where k is the product of the 
leading principal minors of P^DP'^ and we conclude that Pa{A) = => P(j{DA) = 0. For 
the third statement, observe that, from the definition of the polynomials Pt-{A), we have 
that Pr{P(TAP~^) = pT-a{A) which is zero because A is in V. 

We now focus on the last statement of the Proposition. We show that for every a a Sn, 
there exists an integer k^ such that detk„{a{A~'^)) = 0. This implies that P(^{A~^) = as 
required. 

To this end, we recall the Jacobi identity: let B be an invertible matrix. The Jacobi 
identity relates the principal minors of B and the principal minors of B~^. Precisely, it 
says that 

^^*(^-") = di^^^^^- 
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Now, introduce the shorthand notation 

detj(^) = det(^{j+ij+2,..,n}), 

and from the Jacobi identity we deduce that if det j{A) = 0, then det;(^~^) = 0. Now 
because Po-(A) = for ah a € 5„, there exist integers /cg- such that detk„{a{A)) = 0. 
Observe that PaA~^P~^ = (Po-^iV^)"^ ^-iid hence the Jacobi identity yields 

dets^(c7(A-i)) = (8) 

Denote by 77 the permutation that reverses the order of n elements: rj = (n, n — 1, . . . , 1). 
Now given a permutation a written in one-line notation, we define r as 

r = ?7cr = (o-„,CJ„_i,...,(T2,cri). (9) 

The first n — k elements of r are the last n — k elements of a in reverse order. Since 
the absolute value of a determinant is invariant under row and column permutations, we 
conclude that we conclude that 

detj,^{a{A-^)) = ^ detn-kA^iA-^)) = (10) 

Because ([8]) holds for every a E S'n, we conclude that (fTOl) holds for every r G 5„ and thus 
A-^ G V. 

D 

From the above results, we conclude that the space 

U = Sr\V 
contains all the unstable sparse matrix spaces. 

4 Stable and unstable graphs 

We now prove Theorems [U [2] and El Recall that a sink is a node with a self-loop. 

Proof of Theorem Ul Let G = {V, E) be the graph associated to the sparse matrix space 
and assume without loss of generality that it is connected. Let v ^ V and let Vc be the 
strongly connected component to which v belongs. If Vc is empty, and in particular v is 
not a sink, take Vc = {f }. We show that if the subgraph induced by Vc has no sink, then 
G is not stable. 

To this end, split V — Vc into V\^, consisting of vertices Vj such such that there exists 
a path from Vj to at least one vertex Ui G Vc, and Kut consisting of vertices Wi such that 
there exist a path from at least one Ui a Vc to Wi. 



4 Stable and unstable graphs 



12 




/° 


* * 


0\ 





0*0 


* 





0* 








* 


* 


Vo 





*/ 



Fig. 4: The strongly connected component {2, 3, 4} has no sink and thus the graph is 
not stable according to Theorem [TJ With the notation of the proof of Theorem [H 
Mn = {1} and Vout = {5}. The corresponding sparse matrix space, illustrated on 
the right, is upper block diagonal since there are no edges linking V^ut to Vin- The 
block corresponding to the component {2, 3, 4} has a zero diagonal and thus cannot 
have strictly negative eigenvalues. 

There are no edges from V^ut to T^ru since this would contradict the maximality of Vc- 
Order the vertices such that Vi^ = {1, 2, . . . , k}, Vc = {k + 1, . . . ,1} and K)ut = {/ + !,... n}. 
From Lemma [2l we know that the stability properties of the graph with reordered vertices 
are equivalent to the stability properties of the original graph. Because there are no edges 
from V^ut to Vin, the sparse matrix space corresponding to the graph with vertices reordered 
as above consists of upper block triangular matrices, (see Figure H] for an illustration). The 
eigenvalues of such matrices are the eigenvalues of the diagonal blocks. Since the diagonal 
block corresponding to Vc has a zero diagonal-because no vertex is a sink - it cannot be 
stable, and we conclude that no matrix in that space is stable. D 



4.1 Hamiltonian decompositions and stability 

The remaining results rely on a correspondence between Hamiltonian decompositions of 
graphs and permutations of Sn that we explain here. Consider the permutation group Sn 
acting on the set M = {1, 2, . . . , n}. A cycle is a permutation that maps the elements of 
some subset A/i C A/" to each other in a cyclic fashion, while leaving the other elements 
fixed. For example, the permutation (3,1,2,4) is a cycle since it leaves 4 fixed, and maps 
the elements of 5 = {1, 2, 3} to each other in a cyclic fashion, but the permutation (2, 1, 4, 3) 
is not a cycle. 

We adopt the widely used convention of denoting a cycle by i = {iii2, ■ ■ -ik)-, where 
the ik are pairwise different, to indicate that the element in position ii is replaced by the 
element in position ^2) the element in 12 by the one in i^ all the way to z„ by ii while 
the other elements are fixed. We say that two cycles i and j are disjoint if ii 7^ jm for all 
/,m. We call k the order of a cycle and we refer to cycles of order k as A;-cycles. It is a 
well-known fact that any permutation can be written as the composition of disjoint cycles. 
For example, the permutation that sends {1, 2, 3, 4} to {2, 1, 4, 3} is the composition of (12) 
and (34) and is written as (12) (34). It is easy to see that disjoint cycles commute. 
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Now, observe that /c-cycles in Sn can be put in one-to-one correspondence with Hamilto- 
nian cycles going through k vertices in a graph on n vertices: the cycle («ii2^3---) is mapped 
to the Hamiltonian cycle that start at vertex ii, then goes to vertex ^2, etc. and vice- versa. 
In the same vein, to a Hamiltonian decomposition we can assign the composition of the 
necessarily disjoint cycles corresponding to each Hamiltonian cycle. Because the different 
Hamiltonian cycles in a Hamiltonian decomposition do not share vertices, the resulting 
cycles commute and the assignment of a Hamiltonian decomposition to a composition of 
cycles in Sn is well-defined. Returning to the example of Figure [31 the Hamiltonian de- 
composition into {1, 2} and {3, 4, 5} of the graph corresponds to the cycles (12) and (345) 
whose composition is the permutation a = (2, 1, 4, 5, 3). 

proof of Theorem \^ We show that all the matrices in a sparse matrix space S^ that satisfies 
the conditions of the theorem have a characteristic polynomial with a zero coefficient, and 
hence are not stable (see [Kaplan(1962)] , Ch. 7 Th. 1). To this end, write p{A) = 
s" -fpis""^ +P2~ s^~'^ -|- . . . -|- Pn for the characteristic polynomial of A and denote by G 
the graph associated to Sq. It is well-known that 

n 

Pi = -^au,P2 = ^ det(^i);--- ; 

i=l 1X1=2 

Pk = (-1)' Yl det(^i); ■■■■,Pn = (-1)" det(^) (11) 

\X\=k 

where the sums are taken over all subsets Z C A/" of given cardinality. 
In order for pk to be different from, there has to be at least one subset I of cardinality 
k such that det{Ax) is non-zero. Let I* be one such subset. We can express det{Ax*) as 

det^i* = X] n "»'^(»)- 

Hence, there exists at least one permutation, say a* £ Sk, such that Higx* o.ia*{i) is a 
product of free variables. Because free variables correspond to edges in G, the subgraph 
of G on the vertex set {vi,i € I*} has a Hamiltonian decomposition-the decomposition 
corresponding to the permutation a* per the above discussion. Thus if there are no sub- 
graphs of size k admitting a Hamiltonian decomposition, then pk = 0. This proves the 
theorem. D 

Before moving on to the proof of Theorem [3l we relate the existence of non-singular 
matrices in a sparse matrix space to properties of the associated graph: 

Lemma 6. The sparse matrix space associated to a graph admitting a Hamiltonian decom- 
position contains non-singular matrices. 
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Proof. Let A = (uij) be a matrix in the sparse matrix space. We can express its determinant 

as 

n 

det{A)= J](-1)-J]a,.(,). 

Because the associated graph admits a Hamiltonian decomposition, we know from the 
discussion at the beginning of Section |4] that there is at least one permutation a for which 
nr=i '^i(T{i) is the product of free variables. Pick one such permutation, denote it a* and 
assume without loss of generality that it is even. We assign values to the free variables 
that make the matrix non-singular. To this end, let ajo-*(i) = n\,i = 1 . . .n and let all the 
other free variables be equal to 1. For two different permutations a and r, the products 
nr=i ^ia{i) ^iid nr=i ^irit) contain at least a pair of terms ajo-(j) and aj^(j) which are not 
the same, otherwise t = a. This yields the inequalities Y[7=i ^ia{i) ^ {n\)^~^ for a ^ a*, 
which allow us to lower bound the determinant of A as follows 

n n 

detiA) = n«.<x*(i) + E (-l)''n«-W > ("0" - (n! - l){nir-' > 

where we recall that Sn contains n! elements. This concludes the proof. D 

We now give the proof of Theorem [3) 

proof of Theorem O The approach we take to prove the result is the following: we show 
that a sparse matrix space with associated graph satisfying the hypothesis of the theorem 
contains matrices that are diagonally stabilizable, and hence stable, by showing that it is 
not included in V of ([7]). 

Let ii, ^2, . . . , in be integers such that the vertex set of Gi is {vi-^ }, the vertex set of G2 
is {vji , Via}, etc. and set u = (ii, Z2, . . . , in)- We claim that we can find a matrix A in the 
sparse matrix space such that PaiA) ^ 0, which will prove the Theorem. 

Since Gi has a Hamiltonian decomposition with one vertex, it means that aj^j^ is a free 
variable. Thus deti{a{A)) vanishes on a set of codimension 1 in Sq. More generally, since 
Gi admits a Hamiltonian decomposition, from Lemma [6] we know that there are matrices 
in Sa with non-zero determinant, that is deti{a{A)) does not vanish identically on S^. 
Since the determinant is a polynomial function, we conclude that deti{a{A)) vanishes on 
a set of codimension at least one in S^. 

Putting this together, for PaiA) to vanish, at least one of its factors needs to vanish, 
and we have just shown that this happens on the union of sets of codimension one in S^. 
Hence, there are matrices in S^ for which PaiA) 7^ and Sa ^ V D 

5 Maximal and minimal sparse matrix spaces 

We now prove some results about the structure of the set S of sparse matrix spaces. In 
particular, we show that the minimal codimension of an unstable sparse matrix space with 



5 Maximal and minimal sparse matrix spaces 15 

one free variable on the diagonal is 2n — 2. That is, if an unstable sparse matrix space 
contains one non-zero diagonal, then it contains at least n — 1 off-diagonal zeros. Further 
results concerning this phenomenon will appear in a forthcoming publication. As already 
mentioned earlier in this paper, the following relations hold: 

Sq, is stable =^ all S^ such that Sq, C S^ are stable 

and reciprocally 

Sq is unstable =^ all S^ such that S^ C Sq are unstable. 

These inclusions are also easily visualized in terms of the graphs associated to sparse matrix 
spaces: Sq, C S^ means that S^ contains all the edges of Sq, and some additional edges. 
Recall that the dimension of a sparse matrix space is the dimension of the vector space S^ 
and its codimension is rP — dimSc,. In view of the above facts, we introduce the following 
definition: 

Definition 2. 1. We call a sparse matrix space S^ minimally stable if it is stable and 
there are no S^ C Sq, that are stable. 

2. We call a sparse matrix space Sq maximally unstable if it is unstable and there are 
no S/3 D Tia that are unstable. 

Equivalently, a minimally stable graph is a stable graph which can spare no edge while 
remaining stable, and a maximally unstable graph is an unstable graph which becomes 
stable if any edge is added to its edge set. We have the following results: 

Theorem 5. 1. The least dimension of a minimally stable sparse matrix space is n. 

2. The least codimension of a maximally unstable sparse matrix space is n. 

3. There are no maximally unstable sparse matrix space with one non-zero diagonal and 
codimension between n and 2n — 2. . 

Proof. 1. Observe that diagonal matrices form a stable SMS of dimension n and since 
every SMS of dimension strictly less than n contains only rank deficient matrices, it is not 
stable. We denote by S^ the SMS of diagonal matrices. 

2. It is clear that the SMS Sq with zero variables on the diagonal is unstable. We show 
here that any SMS with less than n zero variables is stable, which proves the maximality of 
TiQ. To this end, let G = iy, E) be the graph associated to an arbitrary SMS S with n — 1 
zero variables. We show by induction that the conditions of Theorem [3] are satisfied and 
thus E is stable. We start by observing that G has at least one sink, say vi. We claim that 
there exists at least one vertex, say V2, such the subgraph induced by {^1,^2} (call it G2) 
admits a Hamiltonian decomposition. We consider two cases: first, if at least one vertex 
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besides vi is a sink, then take V2 to be that vertex and we are done. Second, assume that 
no vertex other than vi is a sink. Then ah the n — 1 zero variables of S are on the diagonal 
and, in particular, all the edges {vi,Vj) for i ^ j are in E. Thus G2 admits a Hamiltonian 
cycle. This proves the base case. 

For the inductive step, assume that the subgraph induced by {vi, . . . ,Vk} (call it Gk) 
admits a Hamiltonian decomposition. We will show that there exists a vertex v such that 
the subgraph induced by {vi, . . . ,Vk,v} admits a Hamiltonian decomposition. As above, 
we consider two cases: first, if any vertex in {vk+i, . . . , fn} is a sink, then we can take v to 
be that vertex and we are done. Second, assume that none of these vertices are sinks, then 
S has at least n — k zero variables on the diagonal. Let w = {wiW2 ■ ■ -wi) be a Hamiltonian 
cycle in the Hamiltonian decomposition of Gk- If there is a pair of vertices Wi, v for which 
both edges {wi,v) and {v,Wi+i) are in G, then we can extend the cycle w to a cycle of 
length l + l (see Figure [S]). Because every vertex in Gk belongs to a cycle, there are k{n — k) 
candidate pairs. By a simple counting argument, using the fact that no edge appears more 
than once in {(wi,v), {v, ifj+i)}, there needs to be at least k{n — k) + n — k zero variables 
to prevent the existence of v such that {vi, . . . ,Vk,v} has a Hamiltonian decomposition. 
Because k{n — k) > n — 1 for any A;G{l,2,...,n — 1}, we see that this value is larger than 
n. 

3. We again work with both the matrix and graphical representation of a SMS: consider 
the graph G = {V., E) on n vertices and with the following edge set 

E = {{vi,vi)}\J {{vi,Vj),i / j}, 

that is G is a complete graph with a self- loop on fi, and no other self- loops. This graph 
is easily seen to correspond to a SMS with n — 1 zero diagonals and all other entries free. 
We show that any graph G' obtained from G by subtracting at most n — 2 edges satisfies 
the conditions of Theorem [3] and is thus stable. 

To this end, we show that, starting from Gi = {vi}, we can construct a series of 
subgraphs Gi C G2 C . . . C Gk C . . . C G all of which admit a Hamiltonian cycle, unless 
we subtract at least n — 1 edges from G. The proof is a simple induction on k, the order 
of the subgraph. 

First, observe that there are n — 1 subgraphs of order 2 in G that contain {vi}; they 
are the graphs induced by the vertex sets {vi,Vj} for j ^ 1. Observe that each of these 
graphs contain a Hamiltonian cycle of order 2, namely (Ij), and that no edge appears more 
than once in these Hamiltonian cycles. Hence, if one subtracts at most n — 2 edges from 
G to obtain a graph G', each edge subtraction breaking at most one cycle, there exists 
a subgraph of order 2 in G' which has a Hamiltonian decomposition. This completes the 
proof of the base case. 

For the inductive step, consider a subgraph Gk of order A; in G and assume that Gk has 
a Hamiltonian cycle. We show that unless we subtract at least n — 1 edges from G to obtain 
G', there exists a subgraph Gk+i of G' of order k + 1 which posses a Hamiltonian cycle. 
Assume without loss of generality that (12 ... /c) is the Hamiltonian cycle in Gk and let j € 
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Fig. 5: The subgraph G3 induced by the vertices 1,2,3 has the Hamiltonian cycle (123) 
and is fully connected to the remaining vertices 4 and 5. The subgraph G4, induced 
by the vertex set {1, 2, 3, 4}, has three Hamiltonian cycles as illustrated in row right 
below the larger graph; the cycles are (1234), (1243), (1423). None of the newly 
added edges in Gf (newly added compared to the edge set of G3) appear more than 
once in the cycles. Hence in order to break these three cycles, we need to remove 3 
of the newly added edges at least. The bottom row deals with the subgraph induced 
by the vertex set {1,2,3,5}, that is G^. The conclusion is the same as for Gf and 
we thus need to subtract at least 6 edges to prevent having a Hamiltonian cycle of 
length 4 by adding vertex to G3. 
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{k+1, . . . n}. Then the subgraphs Gj,^^ of G induced by the vertex sets {1,2,..., k, j} have 
each k Hamiltonian cycles: (jl2 . . . k), (lj2 . . . k), . . . (12 . . . jk) as illustrated in Figure [SJ 
There are n — k different subgraphs G^ , ^ and, as above, no edge that is not in the original 
cycle (12 . . .k) appears more than once. Hence, unless we subtract k{n — k) edges from G 
to obtain G', there exists a graph of order A; + 1 in G' which contains a Hamiltonian cycle. 
Because k{n — /c) > n — 1 for any A: € {1, 2, . . . , n — 1}, this concludes the inductive step 
and the proof of point 3. 

D 
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